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DETAILED ACTION 

Response to Arguments 
1. Applicant's arguments filed 8/27/04 have been fully considered but they are not 
persuasive. 

The applicant submits the prior art does not disclose the following limitations of 
the claims: 

1) The Hiroaki reference does not disclose "generating an abstract 
representation of the person" as claimed in claims 1, 10, 12, and 23; 

2) The Hiroaki reference does not disclose "displaying the abstract 
representation to the person such that the abstract representation indicates the 
location of the person within the video capturing volume of the camera" as 
claimed in claims 1, 10, 12, and 23; 

3) The Hiroaki patent fails to disclose displaying the abstract represent 
when the user is within the video capturing volume. The Examiner respectfully 
disagrees. 

Examiner's Response: 

The Hiroaki reference discloses an apparatus and method for indicating a location of a 
person within a video capturing volume. The notification generation section (302) is read on the 
abstract representation generator, which performs the step of "generating an abstraction of the 
person" wherein the remote user's picture 290 and the notification video 390 are synthesized and 
sent to the display (see column 10, lines 61-64) wherein the video image of the local user is used 
as the notification video (see column 1 1, lines 14-15). The video image of the person is read on 
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the abstract representation that is displayed indicating the location of the person within the 
capturing volume. When the user is partially or completely out of range of the camera (see 
column 10, lines 41-44), the video synthesizing section (301) or video processor performs the 
step of displaying the notification video showing the location of the person within the shooting 
range (see column 11, lines 14-15). 

In response to applicant's argument that the references fail to show certain features of 
applicant's invention, it is noted that the features upon which applicant relies (i.e., "displaying 
the abstract represent when the user is within the video capturing volume") are not recited in the 
rejected claim(s). Although the claims are interpreted in light of the specification, limitations 
from the specification are not read into the claims. See In re Van Geuns, 988 F.2d 1 181, 26 
USPQ2d 1057 (Fed. Cir. 1993). 

Therefore, the Hiroaki reference discloses all the claimed limitations of claims 1, 10, 12, 
and 23 as well as these limitations incorporated into the dependent claims. 

Specification 

1 . The disclosure is objected to because of the following informalities: 

The specification is missing a "Brief Summary of the Invention" section. See 
MPEP § 608.01 (d) . 
Appropriate correction is required. 
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Claim Rejections - 35 USC §102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

3. Claims 1-4, 6-10, 12, 13,15 -19, 22, and 23 are rejected under 35 U.S.C. 102(b) as 
being anticipated by Hiroaki, US 5,786,846. 

In regard to claims 1 and 10, Hiroaki, US 5,786,846, discloses a method for 
indicating a location of a user of a two-way communication device within a video 
capturing volume of a camera operably coupled to the two-way communication device 
(see column 3, lines 20-26), the method comprising the steps of: 

receiving at least one image from the camera (column 3, lines 27-29); 
determining a location of the person within the video capturing volume of 
the camera based on the at least one image (see column 3, lines 34-36); 

generating an abstract representation of the person (see column 1 1, lines 1- 
15: An abstract representation of the person in the form of the local user's video 
or a picture an message is generated as a notification video); and 

displaying the abstract representation to the person such that the abstract 
representation indicates the location of the person within the video capturing 
volume of the camera (see column 10, lines 52-64). 

In regard to claims 2 and 3, Hiroaki, US 5,786,846, discloses the method of claim 
1, wherein the step of determining a location of the person comprises the step of 



Application/Control Number: 09/773,863 Page 5 

Art Unit: 2615 

determining locations of the person's head and other portions of the person (see column 8, 
lines 53-56). 

In regard to claim 4, Hiroaki, US 5,786,846, discloses the method of claim 3, 
wherein the step of generating an abstract representation of the person comprises the step 
of generating a plurality of abstract representations, each of the plurality of abstract 
representations corresponding to a respective portion of the person, and wherein the step 
of displaying the abstract representation comprises the step of displaying the plurality of 
abstract representations such that the plurality abstract representations indicate the 
plurality of locations of the respective portions of the person within the video capturing 
volume of the camera (see column 1 1, lines 1-15). 

The abstract representations of each portion of the user are in the image filmed 
on the user side and when displayed as the notification video, each portion of the user is 
shown in its location with respect to the camera. 

In regard to claim 6, Hiroaki, US 5,786,846, discloses the method of claim 1, 
wherein the step of displaying the abstract representation comprises the step of animating 
the abstract representation over a plurality of video frames (see column 11, lines 14 and 
15 and column 6, lines 41-42: The notification video is show as an animated or motion 
picture.) 

In regard to claim 7, Hiroaki, US 5,786,846, discloses the method of claim 1, 
wherein the step of determining a location of the person within the video capturing 
volume of the camera comprises the steps of: 
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determining whether at least a portion of the person is represented in the at 
least one image (see column 3, lines 34-36); and 

in the event that at least a portion of the person is represented in the at 
least one image, determining that the person is within the video capturing volume 
of the camera (see column 3, lines 37-40). 

In regard to claim 8, Hiroaki, US 5,786,846, discloses the method of claim 7, 
wherein the step of displaying the abstract representation comprises the step of displaying 
the abstract representation to the person such that the abstract representation indicates the 
location of the person within the video capturing volume of the camera (see column 1 1, 
lines 12-15). 

In regard to claim 9, Hiroaki, US 5,786,846, discloses the method of claim 7, 
wherein the step of displaying the abstract representation comprises the step of displaying 
- the abstract representation to the person such that the abstract representation indicates 
that the person is outside the video capturing volume of the camera in the event that the at 
least a portion of the person is not represented in the at least one image (see column 1 1, 
lines 12-15). 

In regard to claim 12, Hiroaki, US 5,786,846, discloses an apparatus that is 
operably coupled to a camera (see figure 3), the apparatus comprising: 

a location determiner (see figure 3, element 101), operably coupled to the 
camera, for determining a location of the person within a video capturing volume 
of the camera based on at least one image received from the camera, the at least 
one image including at least a portion of a person (see column 7, lines 1-15); 
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an abstract representation generator (see figure 3, element 302) for 
generating an abstract representation of the person (see column 10, lines 57-60 
and column 11, lines 12-15: Using the local user image video serves as an 
abstract representations displaying the locate of the user with respect to the 
camera); and 

a video processor (see figure 3, element 301), operably coupled to the 
location determiner and the abstract representation generator, for positioning the 
abstract representation in an image to be displayed to the person such that the 
abstract representation indicates the location of the person within the video 
capturing volume of the camera (see column 10, lines 57-60: The video synthesis 
section displays the user's image or abstract representation on the screen to show 
the user that he/she is out of range.). 

In regard to claim 13, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
further comprising: 

a display (see figure 3, display), operably coupled to the video processor, 
for displaying the image containing the abstract representation to the person (see 
column 10, lines 57-60). 

In regard to claim 15, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
further comprising a transmitter for transmitting the at least one image received from the 
camera to a remote device (see column 6, lines 50-63: It is inherent in the Hiroaki 
reference that a transmitter receives/transmits the video signal from the remote user in 
order to display it on the screen for the local user to see.). 
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In regard to claim 16, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
wherein the location is an actual location of the person in the video capturing volume of 
the camera during a video frame processed by the camera (see column 1 1, lines 13-16). 

In regard to claim 17, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
wherein the location is a relative location change within a plurality of video frames 
processed by the camera (see column 1 1, lines 13-16: The user image displayed is a 
continuous video or semi-motion video (see column 6, lines 42-43), so any change in the 
users position will be viewed over several frames.). 

In regard to claim 18, Hiroaki, US 5,786,846, discloses the apparatus of claim 17, 
wherein the relative location change comprises at least one of a translation and a rotation 
(see column 11, lines 13-16: When the user is notified they are out of position by 
displaying the video, their translation from the out of range position to the in range 
position is also displayed.). 

In regard to claim 19, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
wherein the location comprises at least one of a position and a depth (see column 11, 
lines 13-16: The user video depicts the user position and/or depth by the location and size 
of the user in the image on the display.). 

In regard to claim 22, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
wherein the abstract representation further indicates a direction in which the person 
should move in order to be located substantially in a center portion of the video capturing 
volume of the camera (see column 11, lines 3-5 and 13-16: By seeing his/her image on 
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the screen off-centered, the user will intuitively know which direct to move in order to be 

centered in the picture.). 

In regard to claim 23, Hiroaki, US 5,786,846, discloses a two-way communication 

device (see figure 6) comprising: 

a camera (see figure 6, element 602) for capturing an image within a video 
capturing volume of the camera to produce a captured image, the captured image 
including at least a portion of a user of the two-way communication device (see 
column 11, lines 13-16); 

a location determiner (see figure 6, element 101), operably coupled to the 
camera, for determining a location of the person with respect to a video capturing 
volume of the camera based on at least one image received from the camera, the 
at least one image including at least a portion of a person (see column 7, lines 1- 
15); 

an abstract representation generator (see figure 4, element 302) for 
generating an abstract representation of the person (see column 10, lines 57-60 
and column 1 1, lines 12-15: Using the local users image video serves as an 
abstract representations displaying the locate of the user with respect to the 
camera); and 

a receiver (see figure 6, element 601) for receiving an image from a 
second two-way communication device (see column 6, lines 50-63); 

a video processor (see figure 4, element 301), operably coupled to the 
location determiner and the abstract representation generator, for arranging the 
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abstract representation and the image received from the second two-way 
communication device together in a composite image to be displayed to the user 
such that the abstract representation indicates the location of the person within the 
video capturing volume of the camera (see column 12, lines 4-30: The video 
synthesis section displays the both video images, user's image or abstract 
representation and the second user's video image, in secession or at the same time 
on the screen to show the user that he/she is out of range.). 

a display (see figure 6, element 603), operably coupled to the video 
processor, for displaying the composite image to the user; and 

a transmitter (see figure 6, element 601), operably coupled to the camera, 
for communicating the captured image to the second two-way communication 
device (see column 6, lines 50-54). 



Claim Rejections - 35 USC §103 

4. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

5. Claim 5 is rejected under 35 U.S.C 103(a) as being unpatentable over Hiroaki, US 
5,786,846 in view of Wilensky, US 2002/0118875. 

In regard to claim 5, Hiroaki, US 5,786,846, discloses a method of claim 1. 



Hiroaki, US 5,786,846 does not disclose comprising the steps: 
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determining a location of at least one of another person and an object; 
generating a corresponding abstract representation of the at least one of 

another person and an object to produce a second abstract representation; and 
displaying the second abstract representation to the person such that the 

second abstract representation indicates the location of the at least one of another 

person and an object within the video capturing volume of the camera. 

Wilensky, US 2002/01 18875 discloses a method and apparatus for extracting an 
object in the foreground of an image from the background of the image (see paragraph 
33). The user can define multiple objects to be extracted, if the image contains multiple 
objects (see paragraph 36 and figures 1 and 6). Once the objects have been selected, the 
extraction process selects each object one at a time and generates three masks for each 
object (see paragraphs 42 and 55 and figure 5, steps 520-535). Finally, the images are 
assembled showing the objects against a new background (see paragraph 55). In an 
alternative implementation of the invention, one or more objects can be tracked 
automatically throughout a video sequence by selecting the objects in one initial 
keyframe (see paragraph 62). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to have been motivated to modify Hiroaki, US 5,786,846 in view of Wilensky, 
US 2002/01 18875, to have the location detection section detect multiple objects positions 
and perform the steps of claim 5, in order to track the location of multiple objects 
throughout the video sequence. 
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6, Claims 11 and 14 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hiroaki, US 5,786,846. 

In regard to claim 1 1, Hiroaki, US 5,786,846, discloses the method of claim 10, 
further comprising the step of receiving at least one image from a second two-way 
communication device (see column 10, lines 52-58). 

Hiroaki, US 5,786,846, does not disclose, in this embodiment, the step of 
displaying the abstract representation together with the at least one image received from 
the second two-way communication device on the display of the two-way communication 
device. 

Hiroaki, US 5,786,846, discloses that it is well known in the art to display the 
local user's on the screen with the together with the remote user's video (see figure 15 A- 
C and column 1, lines 28-40). The Hiroaki reference teaches that this is done to allow the 
local user to see video filmed from their site to confirm that he/she is located at an 
appropriate position in the shoot range of the camera. 

It would have been obvious to a person skilled in the art at the time of invention 
to have been motivated to modify the Hiroaki reference to have the abstract 
representation of the local user's site displayed together on the same screen with the 
remote user's video in order to allow the local user to see video filmed from their site to 
confirm that he/she is located at an appropriate position in the shoot range of the camera 
as taught by Hiroaki. 

In regard to claim 14, Hiroaki, US 5,786,846, discloses the apparatus of claim 12, 
further comprising a second receiver (see figure 3, communication processing section), 
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operably coupled to the video processor, for receiving an image from a remote device to 
produce a received remotely-generated image (see column 10, lines 52-58). 

Hiroaki, US 5,786,846, does not disclose, in this embodiment, that the video 
processor positions the abstract representation together with the received remotely- 
generated image in an image to be displayed to the person such that the abstract 
representation indicates the location of the person with respect to the video capturing 
volume of the camera, 

Hiroaki, US 5,786,846, does discloses that it is well known in the art to display 
the local user's on the screen with the together with the remote user's video (see figure 15 
A-C and column 1, lines 28-40). The Hiroaki reference teaches that this is done to allow 
the local user to see video filmed from their site to confirm that he/she is located at an 
appropriate position in the shoot range of the camera. 

It would have been obvious to a person skilled in the art at the time of invention 
to have been motivated to modify the Hiroaki reference to have the abstract 
representation of the local user's site displayed together on the same screen with the 
remote user's video in order to allow the local user to see video filmed from their site to 
confirm that he/she is located at an appropriate position in the shoot range of the camera 
as taught by Hiroaki. 

7* Claims 20 and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Hiroaki, US 5,786,846 in view of Hindus et al., US 6,282,206. 

In regard claim 20 and 21, Hiroaki, US, 5,786,846, discloses the apparatus of 
claim 12. The Hiroaki reference does not disclose that the abstract representation 
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comprises an icon or a geometric shape but rather a video image (see column 11, lines 
12-15). 

Hindus et al., US 6,282,206, discloses a two-way video communication system 
that produces low bandwidth output in the form of cartooned video or reduced resolution 
video (see column 10, lines 15-20). The image captured on the local users side is passed 
through a dynamic abstraction filter to create a representational image or icon wherein 
the head and eyes of the person are in the shape of geometric circles (see figure 1, 
element 44 and column 10, lines 20-25). The reference teaches the representational 
image takes relatively few bits per second to transmit any dynamic updates to the image 
from the first communication station (see column 10, lines 25-29). 

It would have been obvious to one skilled in the art at the time of invention to 
have been motivated to modify Hiroaki, US 5,786,846 in view of Hindus et al., US 
6,282,206, to have a dynamic abstraction filter that produces cartooned icons of video 
images as geometric shapes in order to lower the bandwidth of the video data as taught by 
Hindus. 

Conclusion 

8. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
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will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Gevell Selby whose telephone number is 703-305-8623. The 
examiner can normally be reached on 8:00 A.M. - 5:30 PM (every other Friday off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Christensen can be reached on 703-308-9644. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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